Distribution regularized self-supervised learning for domain adaptation of semantic segmentation

نویسندگان

چکیده

This paper proposes a novel pixel-level distribution regularization scheme (DRSL) for self-supervised domain adaptation of semantic segmentation. In typical setting, the classification loss forces segmentation model to greedily learn representations that capture inter-class variations in order determine decision (class) boundary. Due domain-shift, this boundary is unaligned target domain, resulting noisy pseudo labels adversely affecting adaptation. To overcome limitation, along with capturing variation, we intra-class through class-aware multi-modal learning (MMDL). Thus, information necessary explicitly disentangled from discrimination. Features captured thus are much more informative, pseudo-labels low noise. disentanglement allows us perform separate alignments discriminative space and space, using cross-entropy based self-learning former. For later, propose stochastic mode alignment method, by decreasing distance between source pixels map same mode. The metric loss, computed over backpropagated modeling head, acts as regularizer base network shared head. results comprehensive experiments on synthetic real setups, i.e., GTA-V/SYNTHIA Cityscapes, show DRSL outperforms many existing approaches (a minimum margin 2.3% 2.5% mIoU SYNTHIA Cityscapes).

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Diverse Sampling for Self-Supervised Learning of Semantic Segmentation

We propose an approach for learning category-level semantic segmentation purely from image-level classification tags indicating presence of categories. It exploits localization cues that emerge from training classification-tasked convolutional networks, to drive a “self-supervision” process that automatically labels a sparse, diverse training set of points likely to belong to classes of interes...

متن کامل

Adversarial Learning for Semi-Supervised Semantic Segmentation

We propose a method 1 for semi-supervised semantic segmentation using the adversarial network. While most existing discriminators are trained to classify input images as real or fake on the image level, we design a discriminator in a fully convolutional manner to differentiate the predicted probability maps from the ground truth segmentation distribution with the consideration of the spatial re...

متن کامل

Neural Regularized Domain Adaptation for Chinese Word Segmentation

For Chinese word segmentation, the largescale annotated corpora mainly focus on newswire and only a handful of annotated data is available in other domains such as patents and literature. Considering the limited amount of annotated target domain data, it is a challenge for segmenters to learn domain-specific information while avoid getting over-fitted at the same time. In this paper, we propose...

متن کامل

Semi-supervised Domain Adaptation for Weakly Labeled Semantic Video Object Segmentation

Abstract. Deep convolutional neural networks (CNNs) have been immensely successful in many high-level computer vision tasks given large labelled datasets. However, for video semantic object segmentation, a domain where labels are scarce, e↵ectively exploiting the representation power of CNN with limited training data remains a challenge. Simply borrowing the existing pre-trained CNN image recog...

متن کامل

Type-Supervised Domain Adaptation for Joint Segmentation and POS-Tagging

We report an empirical investigation on type-supervised domain adaptation for joint Chinese word segmentation and POS-tagging, making use of domainspecific tag dictionaries and only unlabeled target domain data to improve target-domain accuracies, given a set of annotated source domain sentences. Previous work on POS-tagging of other languages showed that type-supervision can be a competitive a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Image and Vision Computing

سال: 2022

ISSN: ['0262-8856', '1872-8138']

DOI: https://doi.org/10.1016/j.imavis.2022.104504